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Open Access: Counting Gold 


Is Gold Open Access growing? If so, how quickly? More importantly, how 
accurately is the Open Access (OA) movement able to measure its growth? 


At the end of last year | posted a list of what | believed were the main OA 
developments in 2009, which | prefaced with some commentary. In that commentary 
| argued that the rate of progress of both Gold OA and Green OA had accelerated 
during 2009. 


To support my statement about Gold OA | said that over the year 100 more journals 
had been added to the Directory of Open Access Journals (DOAJ). 


Gavin Baker quite rightly challenged my claim about Gold OA, pointing out that in 
reality "fewer journals were added to DOAJ in 2009 than in 2008 — about 100 fewer, 
it looks to be." 


More detailed figures were later published by Peter Suber in the January SPARC 
Open Access Newsletter. In 2009, said Suber, DOAJ "added 723 peer-reviewed OA 
journals, representing 19% growth over the previous year. Last year it grew by 812 
journals or 27%. In 2008, it added 2.2 titles per day, but in 2009 the rate was closer 
to 1.99 titles per day. It now lists a total of 4,535 peer-reviewed OA journals." 


In confirming Baker's claim that 2009 had seen a fall in the growth of Gold OA, Suber 
added that while the DOAJ grew significantly last year, "it grew more slowly in 2009 
than in 2008. So far we don't know why. There could have been fewer new launches, 
which the recession makes likely." 


As such, Baker appears to have been right to challenge my assertion about Gold OA. 
It would have been more accurate, it seems, to have said that Gold OA continued to 
grow in 2009, rather than that growth had accelerated. 


In his newsletter, however, Suber did offer another possible explanation for the 
decrease in the number of journals added to DOAJ in 2009. It could be, he said, that 
"some number of new launches might have gone unnoticed or still be working their 
way through the DOAJ's indexing backlog." 


Nevertheless, Baker's challenge stimulated me to give some thought to how the OA 
movement measures the growth of Gold OA. As a result | have had to conclude that | 
made a more fundamental error than Baker charged me with. For it turns out that 
seeking to measure the growth of Gold OA by counting the number of journals in the 
DOAJ is a deeply flawed approach. 


For instance, as Suber suggests — and publishing consultant Alma Swan confirms 
— the DOAJ registry (in Swan's words) "merely reflects the pace at which the Lund 
people add them.” 


In other words, the team that manages DOAJ (which is based at Lund University 
Libraries) may be struggling to keep pace with the growth of new journals. As Swan 
puts it, "100 journals fewer could just mean that someone in the Lund team had 
swine flu for two months and didn't do as much work as last year". 


My own experience suggests this is likely: In the last few months | have had my 
attention drawn to a number of OA journals that | could not find listed in the DOAJ, 
including Current Issues in Molecular Biology, Microbiology Research, Virulence, 
African Journal of Mathematics and Computer Science Research, Agricultural 
Journal, and Genetics Today. 


Of course some of these journals may not meet the criteria for inclusion in the DOAJ, 
but for several of them at least this seems an unlikely explanation. 


Huge backlog 


When | contacted the Lund team they confirmed that they have been struggling to 
keep up, not least because over the past twelve months they have had fewer people 
assigned to adding journals to the database. There is therefore, | was told, currently 
a "huge backlog" of journals waiting to be added. 
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It is perhaps no surprise then that fewer journals were added to the database in 
2009. Nor does the situation look set to improve in the near future: Staff shortages 
aside, the task of adding new journals to the DOAJ is a time-consuming process, one 
that generally requires a series of interchanges with the editor or owner of the 
journal. 


And in order to keep the directory current a constant weeding process has to take 
place, a process that saw around 100 journals removed from the DOAJ during 2009. 
And the larger the database becomes the more time-consuming managing it will 
surely become. 


All of which would appear to suggest that the number of Gold OA journals is growing 
at a faster rate than is evident if one simply counts those listed in DOAJ. 


On the other hand, there are reasons for arguing that counting the number of 
journals added to the DOAJ might actually overstate, rather than understate, growth. 
How come? Because the date a journal is added to the DOAJ is not necessarily the 
date that it comes into existence. 


As Swan also points out, "Just because a Gold OA journal was added in 2009 does 
not mean that it is a new OA journal. They may be new ones, but not necessarily so. 
They may be pre-existing Gold OAus, or pre-existing journals that turn Gold." 


Swan adds: "When | helped Sally Morris work through DOAJ years ago, checking 
when journals were launched and how much they published there was a huge 
variation, and some of them were relatively old journals — mostly humanities ones 
that had always published for free from university departments of research groups; 
the fact that DOAJ catalogued them in, say, 2005, means nothing if they were 
actually launched in 1989." 


But whether it understates or overstates growth, counting the number of journals 
added to the DOAJ would appear to be a highly inaccurate way of trying to measure 
the growth of Gold OA. 


An alternative approach 


So how do we measure it? Bo-Christer Bjork, who is based at the Hanken School of 
Economics in Helsinki, Finland, has been doing some work on this. He agrees with 
Swan's second point: "A lot of journals have joined DOAJ much later than they were 
started, so the growth might be overstated." 


Consequently Bjork has adopted an alternative approach. Instead of using DOAJ he 
has been using Ullrich's Periodicals Directory for his IT-barometer study. As he 
explains: "We undertook a search for peer reviewed, scholarly journals, with a 
particular start year, and then searched for all journals versus Open Access 
journals." 


Below is a graph Bjork created using that data, which plots the growth of new OA 
journals as a percentage of all new journals. 
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The graph suggests that the percentage of new journals created as OA journals in 
2007 was 32%. In terms of growth, says Bjork, "The share has been quite stable 
since 2000." 


However while Bjork was able to avoid the time-lag issues associated with using 
DOAJ, he experienced the same problem with regard to journals converting to OA. 
As he puts it, "It is very difficult to trace the development of Gold OA backwards. The 
information is as accurate as the background data in Ullrich's. It also doesn't tell you 
when a journal may have become OA, so some of these may have swapped model." 
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growth appears even more modest. As he puts it: "Calculated over the number of 
articles the increase is likely to be even lower [than 0.5%], since the yearly article 


volume of newly-founded journals is low (with the exception of the PLoS journals)." Blog Archive 
As such, Bjork's work highlights a further problem: Not only does counting the 2020 (4) 
number of journals listed in the DOAJ produce a very inaccurate picture of the growth 
of Gold OA, it is also unlikely to reveal Gold OA's true share of the market, since the 2019 (7) 
number of papers published in OA journals tends to be lower than in subscription 2018 (20) 
journals. As Swan puts it, "Some Gold journals publish one article per century; others 
publish hundreds per year." AOVE(IS) 

2016 (14) 
Explains Swan: "It is easier to launch a non-OA journal in terms of gathering articles, 
because there is no charge to the authors for publishing in a non-OA journal." By 2015°(18) 
contrast, she adds, "OA journals may struggle a bit for authors, especially before 2014 (13) 
they have built a reputation." 2013 (32) 
Moreover, the difference between OA journals themselves can be quite stark. 2012 (43) 
Contrast, for instance, a typical OA journal publishing a handful of articles a year with 2011 (22) 
PLoS ONE. 

2010 (20) 
For a number of reasons, not least its multidisciplinary approach, PLoS ONE has November (1) 
experienced explosive growth since its launch on 20'" December 2006. During the October (2) 
few days that remained of 2006 PLoS ONE published 138 papers. In 2007 it 
published 1,231 articles, and in 2008 2,726 articles — a 120% increase on the year. September (1) 
By the end of last year, says PLoS ONE publications manager Rebecca Walton, PuGiAE() 
PLoS ONE had published 4,400 papers (a 65% increase on 2008), taking the total June (3) 
since launch to 8,495. May (4) 
Anticipating that PLoS ONE will publish 6,600 papers in 2010 (a further 50% March (2) 
increase), Walton expects that this year it will become the largest scholarly journal in February (3) 
the world by volume of published research articles. She explains: "We believe we are 
the third largest scholarly journal in the world, behind Physical Review B and Applied January (1) 
Physics Letters, and in 2010 we will become the largest." Open Access: 

Counting 

As such, PLoS ONE could now be publishing the same number of papers as 100 Gold 
regular OA journals. 

2009 (22) 
The truth of the matter, concludes Swan, is that — whatever source one uses — 2008 (14) 
trying to measure the growth of Gold OA by counting journals "is an unsatisfactory 
methodology". 2007 (9) 
With the growth of Hybrid OA (where an author can continue to publish in a age 27) 
subscription journal but opt to pay to have individual papers made OA) the 2005 (31) 
pointlessness of counting Gold OA journals becomes even more pronounced. In 2004 (2) 
such an environment, the only meaningful way of sizing Gold OA is to count articles, 
not the number of Gold journals. 
In short, the OA movement really needs to abandon its fixation on counting journals Followers 
and concentrate on papers. "The best way to measure growth would be by number 
of Gold articles published each year," says Swan. Followers (117) Next 
However, she adds: "No-one is monitoring that. Bo-Christer Bjork's people have a £ SS = “é, 


methodology for assessing the proportion of all the literature that is OA, but | don't 
know if they differentiate between Green and Gold that way." 


Considerable frustration 


Actually, says Bjork, he does differentiate between Green and Gold OA, and his 
figures suggest that the overall percentage of articles published as Gold OA in 2008 
was 9.3% (With around 11.8% available as Green OA, giving an overall OA 
percentage of around 21%). 


Bjork's figures, we should note, also include papers published as Hybrid OA (24% of 
his Gold OA total). 


"The method we have is based on googling with a sample of journal articles," he 
explains, adding that a similar method has been used in a very thorough study by a 
group of Japanese researchers in the biomedical field. "Their results are slightly 
higher than ours and we have yet to analyse from where the difference stems." 








(The Japanese study, published in January last year, estimated that, at the time of 
the study, 27% of articles published in biomedicine were available on an OA basis). 


Nevertheless, since Bjork's main focus is on taking a snapshot of the current 
situation, rather than measuring the growth of Gold OA, his figures don't take us 
much further forward if our aim is to track growth over time. 


So we are left with the question we began with: Is Gold OA growing? If so, how 
quickly, and is that growth accelerating? "| have no evidence to show any 
acceleration in growth, " says Bjérk. "On the contrary it seems that growth has been 
relatively stable, after a short expansive period when BioMed Central and PLoS were 
founded" 


In short, we simply don't know how fast Gold OA is growing, or even if it is growing. 
We assume that it is, but no one seems able to demonstrate this in a convincing way. 


All in all, while Baker appears to have been right to challenge my claim that the 
growth of Gold OA accelerated in 2009, he should perhaps have gone on to point out 
that counting Gold journals is not the way to track the growth of OA anyway. 


Meanwhile, for some OA advocates the absence of reliable data here is a source of 
considerable frustration. Leo Waaijers, manager of the SURF Platform ICT and 
Research, for instance, would dearly like to see some accurate figures on the growth 
of Gold OA. 


When | asked Waaijers if he knew whether this information was available he replied: 
"| have been thinking about this and looking around over the last few days but | could 
not find any reliable source. All in all it is a strange thought: in a period of information 
overload we seem not to be able to produce a more or less accurate record of an 
important development in scientific and scholarly communication." 


There is scope here, it would seem, for someone to provide a useful service! 


Posted by Richard Poynder at 18:22 | o 


1 comment: 


Héléne Bosc said... 


| confirm that Ulrich database is the only source for counting journals. 
Below, you will find a pasted PPT summarizing the study | did at the end 
of 2004, using Ulrich database. My data are not the same as Bjork. 
Curiously, only the data of 2001 are approximatively the same. It would 
be interesting to know how he proceeded because | remember that this 
research was "difficult". You have to remove a lot of "parasites", in using 
"NOT". | am not sure of my study, which was not reviewed but this 
difference shows that you must be very carefull in your research in using 
Ulrich database. 

You can see that in my study there is a general decrease (new 
periodicals and OA periodicals) between 2001 and 2004. (data not 
reported in 2004 because | did the study in November). 12.4% was the 
result till November. 


2001 : 308 new periodicals including 63 OA = 20.5% OA 
2002 : 255 new periodicals including 47 OA = 18.4% OA 
2003 : 198 new periodicals including 30 OA = 15.2% OA 
2004 = 12.4% OA 


On the other part , like Alma Swan, | contributed to the study on OA 
periodicals for Sally Morris some years ago and | had a large part of 
BMC journals to study. | discovered that some were "healthy" but that 
some others were nearly empty! Therefore a journal can exist but it does 
not give the value of the growth of gold OA articles. The example of 
PLOS one that you are giving is a good one, because an electronic 
journal is elastic and it can provide thousand articles a year or only 10. 
OA gold articles are the only value to count. 

In my opinion, 5 years ago it was possible to ask to some volunteers to 
count the number of articles in OA journals (| think that we were about 
10-15 to do the work for Sally ) but now, given the number of OA 
periodicals it seems me impossible. 
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